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7^oo  Control  of  Nonlinear  Systems: 
A  Convex  Characterization 

Wei-Min  Lu*  and  John  C.  Doyle* 

October  22,  1993 


Abstract 

The  so-called  nonlinear  7^OT-control  problem  in  state  space  is  considered  with  an  emphasis 
on  developing  machinery  with  promising  computational  properties.  Both  state  feedback  and 
output  feedback  77oo-control  problems  for  a  class  of  nonlinear  systems  are  characterized  in 
terms  of  continuous  positive  definite  solutions  of  algebraic  nonlinear  matrix  inequalities  which 
are  convex  feasibility  problems.  The  issue  of  existence  of  solutions  to  these  nonlinear  matrix 
inequalities  (NLMIs)  is  justified. 


1  Introduction 

Linear  77oo  control  theory  has  been  a  very  popular  research  area  since  it  was  originally  formulated 
by  Zames  (cf.  [8,  5,  7])  .  The  simplicity  of  the  characterization  of  state  space  77oo- control  theory 
together  with  its  clear  connections  with  traditional  methods  in  optimal  control  [7]  have  stimulated 
several  attempts  to  generalize  the  linear  77oo  results  in  state  space  to  nonlinear  systems  [26, 14,  2,  19]. 
We  will  use  the  accepted  but  unfortunate  misnomer  “nonlinear  77oo”  to  describe  this  research 
direction,  which  will  be  pursued  further  in  this  paper,  with  an  eye  toward  computational  issues. 

Basically,  in  those  generalizations,  the  necessary  or  sufficient  conditions  for  the  the  77 oo -control 
problem  to  be  solvable  are  characterized  in  terms  of  some  Hamilton-Jacobi  equations  or  inequalities 
[26,  14,  2,  19,  13,  27,  17].  Specially,  an  77oo  output  controller,  which  has  separation  structure,  and 
a  class  of  parametrized  77oo  controllers  are  designed  based  on  the  required  solutions  of  Hamilton- 
Jacobi  equations  or  inequalities  [14,  19].  Whence,  one  of  the  major  concerns  in  the  state-space 
nonlinear  77oo-control  theory  is  how  to  solve  these  Hamilton-Jacobi  partial  differential  equations  or 
inequalities,  and  progress  along  this  line  would  be  beneficial  to  applications  of  nonlinear  77oo-control 
theory.  For  example,  van  der  Schaft  [26]  proposed  an  approach  to  approximate  the  solutions  of 
Hamilton-Jacobi  equations  using  Lukes’  iteration  method  [21], 

In  this  paper,  we  propose  an  alternative  approach  to  the  state-space  nonlinear  77oo -control 
problem,  and  characterize  the  solutions  in  terms  of  convex  conditions  instead  of  the  Hamilton-Jacobi 
equations  or  inequalities.  This  is  motivated  by  the  fact  that,  essentially,  the  linear  77oo-control 
problem  can  be  characterized  as  a  convex  problem  [23,  3].  We  examine  the  convexity  of  the  nonlinear 
77oo-control  problem,  and  deal  with  a  class  of  nonlinear  77oo-control  problem  whose  solvability 
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conditions  are  convexly  characterized  as  some  algebraic  nonlinear  matrix  inequalities  (NLMIs). 
This  makes  the  computation  very  appealing,  since  the  solutions  to  this  class  of  nonlinear  Tioo 
problems  are  based  on  the  required  solutions  to  the  corresponding  algebraic  NLMIs,  which  can  be 
solved  via  the  convex  optimization  methods[3].  The  analogical  treatments  in  linear  case,  which  are 
characterized  in  terms  of  linear  matrix  inequalities  (LMIs),  can  be  found  in  [20,  22,  18,  24,  9,  15]. 

The  other  features  of  the  suggested  approach  are  that  the  nonlinear  system  considered  has  few 
structural  constraints;  the  system  coefficient  functions  are  just  required  to  be  continuous,  no  other 
smoothness  is  needed;  our  attention  is  not  just  paid  to  local  solutions,  the  system  is  considered 
to  evolve  in  some  prescribed  open  convex  set;  in  this  framework,  it  is  proved  by  using  set- valued 
map  machinery  that  if  a  concerned  NLMI  has  solutions,  then  it  has  a  continuous  solution  which 
is  required  for  the  Tfoo- control  problem  to  be  solvable;  the  algebraic  NLMIs  are  in  fact  the  state- 
dependent  LMIs,  therefore,  the  existing  convex  optimization  methods  for  solving  LMIs  can  be  used 
in  the  practical  computation  for  solving  NLMIs.  Unfortunately,  unlike  the  linear  case,  the  solution 
of  the  NLMIs  by  themselves  are  not  sufficient  to  guarantee  the  existence  of  the  required  controller, 
and  the  computational  implications  of  the  required  additional  constraints  on  the  NLMI  solutions 
are  not  clear.  This  issue  is  discussed  more  in  the  body  of  the  paper. 

This  paper  is  organized  as  follows:  In  section  2,  some  background  material  related  to  the  C2- 
gains  analysis  is  provided;  the  NLMI  characterization  of  £2-gains  is  given.  In  section  3,  the  Pi^- 
control  problem  is  stated.  In  section  4,  the  control  problem  for  state-feedback  is  considered; 
both  static  feedback  and  dynamic  feedback  are  examined.  In  section  5,  the  main  results  of  this 
paper,  i.e.,  solutions  to  the  output  feedback  Tfoc-control  problem,  are  given;  the  solvability  of 
this  problem  is  convexly  characterized  by  two  NLMIs  and  a  coupling  condition.  In  section  6,  the 
existence  of  the  solutions  to  these  NLMIs  is  confirmed  under  some  mild  conditions.  Some  required 
technical  material  is  reviewed  in  the  appendix. 

The  following  conventions  are  made  in  this  paper.  R  is  the  set  of  real  numbers,  E+  :=  [0,  oo)  C 
R.  Rn  is  ^-dimensional  real  Euclidean  space;  ||-||  stands  for  the  Euclidean  norm.  For  Br,  it  is 
understood  to  be  the  open  ball  in  some  Euclidean  space  with  some  radius  r  >  0  which  is  measured 
by  Euclidean  norm.  X  (or  X0)  is  the  state  set  which  is  a  convex  open  subset  of  some  Euclidean 
space  and  contains  the  origin.  Rnxm  (Cixm)  is  the  set  of  all  n  x  m  real  (complex)  matrices.  The 
transpose  of  some  matrix  M  £  RnXn  is  denoted  by  MT .  By  P  >  0  (P  >  0)  for  some  Hermitian 
matrix  P  £  R"x"  or  (C*Xm)  we  mean  that  the  matrix  is  (semi-)positive  definite.  A  function  is  said 
to  be  of  class  Ck  if  it  is  continuously  differentiable  k  times;  so  C°  stands  for  the  class  of  continuous 
functions. 

2  Preliminaries:  £2-Gains  and  Strong  7ioo-Performances 

In  this  section,  some  background  material  about  £2-gain  analysis  of  nonlinear  systems  is  provided. 
The  reader  is  referred  to  Willems  [28]  and  van  der  Schaft  [26]  for  more  details. 
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2.1  ZVGam  Analysis 

Consider  the  following  affine  nonlinear  time-invariant  (NLTI)  system: 

„  f  x  =  A(x)x  +  B(x)w 

’  (  z  =  C(x)x  +  D(x)w  '  ' 

where  x  £  R"  is  state  vector,  w  E  Rp  and  z£l!  are  input  and  output  vectors,  respectively.  We 
will  assume  A ,  B,  C,  D  are  C°  matrix- valued  functions  of  suitable  dimensions.  From  now  on  we  will 
assume  the  system  evolves  on  a  convex  open  subset  Xci“  containing  the  origin.  Thus,  0  E  Rn 
is  the  equilibrium  of  the  system  with  w  =  0.  The  state  transition  function  f>  :  R+  X  X  X  Rp  — »■  X 
is  so  defined  that  x  =  <j>(T,x0,w*)  means  that  system  G  evolves  from  initial  state  x0  to  state  x  in 
time  T  under  the  control  action  w*. 

Definition  2.1  (i)  The  system  G  (or  [A{x),  B(x)\)  is  reachable  from  0  if  for  all  x  E  X,  there 
exist  T  E  R+  and  w*(t )  E  £2[0,T]  such  that  x  =  4>(T,  0,  u>*); 

(ii)  The  system  G  (or  [C(x),  A(x)\)  is  (zero-state)  detectable  if  for  all  x  EX,  h(<f>(t,x,  0))  = 

0  =?>  4>(t,  x,  0)— >0  as  t-*  oo;  it  is  (zero-state)  observable  if  for  all  x  EX,  h(4>(t ,  x,  0))  =  0  =>  f>(t,  x,  0) 
0  for  all  t  E  R+. 

Definition  2.2  The  system  G  with  initial  state  :r(0)  =  0  is  said  to  have  £2-gain  less  than  or 
equal  to  7  for  some  j  >  0  if 

T  T 

f  \\z(t)\\2  dt  <  12  f  \\w(t)\\2  dt  (2) 

Jo  Jo 

for  all  T  >  0  and  w(t )  E  £2[0,T],  and  z(t )  =  h(<f>(t,  0,  w(t))  +  k(<f>(t,0,w(t))w(t). 

In  the  following  discussion,  we  only  consider  the  case  7  =  1  without  loss  of  generality.  Define 

eOO 

Va{x)  :=  sup  -  /  (IHt)ll2  -  \W)\\2)dt-  (3) 

^€^2[0>oo),a?(0)=ir  JO 

Note  that  Va(x )  >  0  for  all  x  E  X,  and  if  the  system  has  £2-gain  <  1,  then  Va(0)  =  0.  We  will 
assume  14(0)  =  0  from  now  on. 

As  pointed  out  by  Willems  [28],  Va(x )  <  00  if  and  only  if  there  exists  a  function  V  :  X— >R+ 
with  V(0)  =  0,  which  is  called  storage  function  in  [28],  such  that: 

T>i(V,xtw)  :=  V(x)  -  V(x0)  -  [  (||u;(/)||2  -  ||2:(t)||2)df  <  0  (4) 

Jo 

where  x  =  <f>(T,  x0,  w(t))  and  w(t)  E  £2[0,  T\,  and  Vo(-)  is  also  a  solution.  Moreover,  the  solutions  to 
(4)  form  a  convex  set,  and  any  solution  V(x)  >  0  for  x  E  X  with  F(0)  =  0  satisfies  V(x )  >  Va(x). 

Lemma  2.1  (Willems  [28]) 

Suppose  system  G  is  reachable  from  0.  It  has  L^-gain  <  1  if  and  only  if  Va(x)  <  00,  for  all 
x  EX. 
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Thus,  if  the  system  is  reachable  from  0,  then  £2-gain  <  1  if  and  only  if  Va(x)  >  0  is  well-defined 
for  all  i£X,  and  there  exists  a  solution  V(x )  >  0  to  the  above  (4).  Now  assume  Va(x )  and  V(x) 
are  of  class  C1  and  can  be  writen  as 

Va(x)  =  xTQax  +  ra(x),  V(x)  =  xTQx  +  r(x) 
for  some  Qa,Q  >  0  and  C1  functions  ra,r  :  X— >-R  satisfying 


lim 

x— >>0 


M®)l 


=  o, 


lim 

x—+0 


K*)l 


o. 


.1*11  11*11 

Since  14(0)  =  0, 14(0)  =  0,  there  are  C°  matrix- valued  functions  Pa,P  :  X- 


ixn  such  that 


dVa 


(*)  =  2x  Pj(x), 


dv 


(x)  =  2  xTPT(x). 


dx  v  '  oV  Ox 

Now  for  matrix- valued  function  P  :  X— >-R"xn,  let  R(x)  :=  I  —  DT{x)D{x)  >  0,  we  define 
H{P,x)  :=  PT (x)(A(x)  —  B(x)R~1(x)DT (x)C(x))  +  ( AT{x )  —  CT (x)D(x)R~T (x)BT (x))P(x)+ 
+PT(x)P(x)P-1(x)PT(x)P(x )  +  CT(x)(I  -  D(x)DT(x))~1C(x).  (5) 


The  following  standard  result  characterizes  a  class  of  nonlinear  systems  having  £2-gain  <  1. 

Lemma  2.2  Consider  a  system  G  with  R(x)  :=  I  —  DT(x)D(x)  >  0  for  all  x  e  X;  suppose  G  has 
C2-gain  <  1,  and  Va,V  :  X— >-R+  are  defined  as  above. 

i)  If  Pa  :  X-+RnXn  is  such  that  ^f-(x)  =  2 xTPf(x),  then  xT'H.(Pa,x)x  =  0; 

ii)  If  P  :  X— »Rnx"  is  such  that  |^(x)  =  2 xTPT(x),  then  xT7i(P,x)x  <  0. 


Proof  See  [26,  19].  □ 

Recall  that  V  :  X-^R+  is  locally  positive-definite  if  there  exists  r  >  0  such  that  for  x  E  Br, 
V(x )  =  0=4»x  =  0;  it  is  globally  positive-definite  if  F(x)  =  0=4-x  =  0,  and  lim^oo  V{x)  =  oo.  It  is 
easy  to  see  that  the  converse  results  in  the  above  lemma  are  also  true. 

Proposition  2.3  Suppose  there  is  a  C°  matrix-valued  function  P  :  X^RnXn,  such  that  H(P,x)  < 
0  for  all  x  G  X,  and  there  is  a  non-negative  function  V(x)  >  0  such  that  |^(x)  =  2 xTPT(x),  then 
the  concerned  system  has  L^-gain  <  1. 


Proof  Note  that  Ti(P,x)  <  0  implies 

At(x)P(x)  +  Pr(x)A(x)  <  -CT (x)C(x)+ 

— (PT(x)P(x)  +  Ct(x)D(x))(I  -  Dt(x)D(x))~1(Bt (x)P(x)  +  DT (x)C(x)).  (6) 

Take  V  as  defined  in  the  statement,  then 

CM  =  ^(x)(A(x)*  +  B(x)w)  =  2x^Ppx)(A(x)x  +  B(x)w) 
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=  xT  (PT  (x)A(x)  +  At(x)P(x))x  +  2xT  PT  (x)B(x)w 


(7) 


<  |H*)||2  -  |K#) ||2  -  ||ti>(<)  +  R-\x)DT(x)C(x)x  +  R~\x)BT{x)P(x)xf 

The  latter  inequality  follows  by  replacing  PT(x)A(x)  +  Ar(x)P(x)  in  (6)  into  (7)  and  reorganizing 
it.  Therefore, 

H*)  -  (IKOII2  -  HOlf)  <  o. 

Take  the  integral  from  t  —  0  to  t  =  T,  the  above  inequality  implies  inequality  (4),  which  in  turn 
implies  the  system  has  £2-gain  <  1  since  V{x)  >0.  □ 


Note  that  in  the  above  characterization  the  solution  P  to  H(P,  x)  <  0  is  not  required  to  be  (semi- 
positive  definite,  even  symmetric.  However,  the  solutions  can  be  chosen  as  positive  definite  in  the 
cases  of  interest  in  the  present  paper;  this  is  justified  in  the  next  subsection.  If  P(x )  =  PT(x)  >  0 
for  x  e  X,  then  V(x)  with  F(0)  =  0  satisfying  j^(x)  =  2 xTP(x)  is  (locally)  positive  definite  (see 
lemma  8.3). 

The  following  statement,  which  is  due  to  Hill  and  Moylan  (see  [26]),  establishes  the  relationship 
between  finite  gain  (stability)  and  asymptotic  stability. 

Lemma  2.4  (i)  Suppose  the  system  G  with  u  =  0  is  asymptotically  stable  at  0,  then  any  V(x)  with 
F(0)  =  0  satisfying  |^( x )  =  2 xT PT{x)  such  that  H(P,x)  <  0  is  such  that  V(x)  >  0  for  all  x  E  X. 

(ii)  Assume  system  G  is  zero-state  detectable.  If  there  is  a  positive  definite  function  V{x)  with 
F(0)  =  0,  j^(x)  =  2 xTPT(x)  such  that  ? I(P,x)  <  0,  then  the  system  G  with  u  =  0  is  asymptotically 
stable  at  0. 


Now  there  comes  up  the  main  result  of  this  section,  which  characterizes  the  £2-gain  of  the 
system. 


Theorem  2.5  Consider  the  system  G  given  by  (1),  suppose  I  —  DT(x)D(x)  >  0.  Given  any  C° 
matrix-valued  function  P  :  X— >-Mnxn,  the  following  inequalities  are  equivalent. 

(i)  P  satisfies  7 i(P,x)  <  0; 

(ii)  P  satisfies 


M(P,x) 


AT(x)P(x)  +  PT(x)A(x)  +  CT(x)C(x) 
BT(x)P(x)  +  DT(x)C(x) 


PT{x)B(x)  +  CT(x)D(x) 
DT(x)D(x)-I 


<0;  (8) 


(Hi)  P  satisfies 


M(P,x ) 


AT(x)P(x)  +  Pt(x)A(x)  PT{x)B(x)  Ct(x ) 
BT(x)P(x)  -I  DT(x) 

C(x)  D(x )  -I 


<  o. 


(9) 


In  addition,  suppose  the  considered  system  is  asymptotically  stable  with  w  =  0.  If  there  are  a 
C°  matrix-valued  function  P  :  X— ►Rnxn  satisfying  any  of  the  above  inequalities  and  a  function 
V  :  X— such  that  |^( x )  =  2 xPT(x),  then  the  system  has  C-2-gain  <  1. 


5 


Inequalities  (8)  and  (9)  are  actually  a  state-dependent  linear  matrix  inequalities.  We  call  them 
nonlinear  matrix  inequalities  (NLMIs)  here  to  emphasize  that  they  are  used  to  deal  with 
nonlinear  systems.  In  section  6,  we  shall  consider  the  computational  issue  in  solving  NLMIs.  It 
should  be  emphasized  that  the  existence  of  a  C°  matrix- valued  function  P  :  X— s-R"xn  which  satisfies 
any  of  the  above  inequalities  is  not  enough  to  guarantee  the  system  to  have  £2-gain  <  1;  in  this 
theorem,  it  is  additionally  required  that  there  exists  a  function  V  :  X— >R  such  that  = 

2 xTPT(x).  (See  lemma  8.2  for  a  characterization  of  a  class  of  matrix-valued  function  P  :  X— >R”X" 
which  satisfies  this  additional  requirement.) 

Proof  Reorganize  the  left  hand  side  of  the  inequality  TL(P,x)  <  0, 

H(P,x )  =  AT(x)P(x)  +  PT(x)A(x)  +  CT(x)C(x)+ 

+(PT(x)B(x)  +  CT(x)D(x))(I-  DT(x)D(x))-\BT(x)P(x)  +  DT(x)C(x))  <  0.  (10) 

So  by  using  the  standard  result  about  Schur  complements,  we  have  TL{P,x)  <  0  if  and  only  if 
Ai(P,  x)  <  0  or  M(P,  x)  <  0,  since  it  is  assumed  I  —  DT(x)D(x)  >  0. 

If  the  C°  matrix- valued  function  P  satisfies  any  of  the  above  inequalities  and  there  is  a  function 
V  :  X->R  with  1/(0)  =  0  such  that  %{x)  -  2 xTPT(x).  By  preceding  lemma,  V(x )  >  0.  Therefore, 
by  proposition  2.3,  the  system  has  £2-gain  <  1.  d 


Remark  2.1  If  there  is  a  C°  matrix-valued  matrix  P0  such  that  M(Po,x )  <  0  for  i£X,  then  by 
continuity  of  M  with  respect  to  x,  there  is  another  C°  matrix-valued  matrix  P  such  that  M(P,x )  < 
0  and  j^-(x)  =  2 xTPT(x)  for  some  C1  function  V  :  for  some  d  >  0.  In  fact,  a  natural  choice 

is  P  =  Po(0),  and  V(x)  =  xTPx.  Therefore,  in  this  paper,  the  requirement  that  jp(x)  =  2 xT P1  (x) 
for  a  C°  solution  P(x)  to  any  NLMI  and  a  C1  function  V(x)  is  not  very  strong  in  a  local  sense. 


2.2  Solutions  to  NLMIs  and  Strong  Tfoo-Performances 

Consider  the  NLMI  (8)  or  (9).  By  theorem  2.5,  there  exists  a  matrix  valued  function  P  :  X— dRnxn 
such  that  M(P,x )  <  0  or  M(P,x)  <  0  if  and  only  if  there  exists  a  matrix  valued  function  Q  : 
X-^R"X"  with  Q(x)  >  0  for  all  x  6  X  such  that 


H(P,x)  +  Q(x)  =  0. 

Let  R(x)  :=  I  -  DT(x)D(x )  >  0,  define  a  state-dependent  Hamiltonian  H  :  X-^R2nx2'1 

+  I  /-cr  t\( I  R~\x)  \  DT(x)C(x)  BT(x ) 


as 


H{x)  := 


A(x)  0 

-CT(x)C(x)  -  Q(x)  -AT{x) 


B(x) 

- Ct(x)D(x ) 


(11) 


Now  for  fixed  x  E  X,  A  is  an  eigenvalue  of  H(x)  if  and  only  if  -A  is.  Hence,  there  must  be  at  least 
n  eigenvalues  for  H(x)  in  half  plane  Re(s)  <  0.  Suppose  that  we  choose  an  n-dimensional  invariant 
subspace,  denoted  by  X_(H(x)),  corresponding  to  the  n  eigenvalues  in  Re(s)  <  0  and 


X_(H(x))  =  Span 


X ! 
X2 


(12) 
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where  Xi,X2  G  Cixn ,  and 


H{x)  y1  =  y1  Tx.Re(\i{Tx))  <  OVi  (13) 

-A  2  A  2 

If  Xj  is  invertible,  set  X  :=  X2X1~1,  suppose  in  addition  X  is  Hermitian,  then  the  map 

Ric  :  H(x)  X  (14) 

is  well  defined  [10],  and  its  domain  dom(Ric)  will  be  taken  to  consist  of  Hamiltonian  matrices  with 
the  above  properties.  So  we  have  the  following  result  which  is  essentially  from  [10,  lemma  2.4]  and 
theorem  2.5. 

Theorem  2.6  M(P,x )  <  0  has  non-negative  definite  solutions  P(x)  >  0  if  and  only  if  the 
state- dependent  Hamiltonian  H  :  X-»R2nx2n  defined  in  (11)  for  some  matrix-valued  function 
Q  :  X— ►Rnx"  with  Q(x)  >  0  for  all  x  G  X  is  in  dom(Ric),  i.e.  H(x)  G  dom(Ric)  for  each 
x  G  X.  Moreover,  Ric(H(x ))  >  0  is  such  a  solution.  In  addition,  if  for  each  x  G  X, 

n-~  1 

P|  ker (C(x)Al(x))  =  0, 

i= 0 

this  solution  is  positive  definite,  i.e.,  Ric(H(x ))  >  0. 

The  above  theorem  implies  that  under  the  condition  H(x )  G  dom(Ric)  for  each  x  G  X,  which 
is  not  restrictive  at  all,  the  NLMI  M(P,x)  <  0  has  non-negative  definite  solutions.  In  section  6, 
we  will  further  show  that  such  solutions  can  be  chosen  to  be  continuous  in  the  cases  of  interest  in 
this  paper.  A  nice  convex  property  for  NLMIs  is  stated  by  the  following  proposition  whose  proof 
is  easy  and  omitted  here. 

Proposition  2.7  The  C°  solutions  P  :  X— >R”xn  to  NLMI  M{P,x)  <  0  form  a  convex  set;  the 
subset  of  all  C°  non-negative  definite  solution  P  =  PT  :  X— dR"xra  such  that  §~(a;)  =  2 xTP(x)  for 
some  function  V  :  X— >R  is  convex;  the  subset  of  all  C1  positive  definite  solutions  PT(x)  =  P(x)  >  0 
such  that  |^( x )  =  2 xT P(x)  for  some  function  V  :  X— is  also  convex. 

It  is  noted  that  by  lemma  8.3,  the  C1  function  V  :  X— >R  which  satisfies  ^r(x)  =  2xT P(x)  for 
some  positive  definite  solutions  PT(x)  =  P(x)  >  0  and  F(0)  =  0  is  positive  definite  on  X.  Now  we 
close  this  section  by  defining  a  stronger  Woo -performance. 

Definition  2.3  The  concerned  system  is  said  to  have  strong  Woo-performance  if  there  is  a  C° 
positive  definite  function  P(x)  =  PT(x)  >  0  which  satisfies  any  of  inequalities  (8)  and  (9)  for  all 
x  G  X  such  that  ^r(x)  =  2 xTP(x)  for  some  C1  function  V  :  X— dR. 

So  if  system  has  a  strong  Woo -performance,  by  lemma  8.3,  proposition  2.3  and  theorem  2.5,  it 
has  £2-gain  <  1. 
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3  Woo- Control  Problem 

The  feedback  configuration  for  the  Tfoo-control  synthesis  problem  is  depicted  as  follows, 


where  G  is  the  nonlinear  plant  with  two  sets  of  inputs:  the  exogenous  disturbance  inputs  w  and  the 
control  inputs  u ,  and  two  sets  of  outputs:  the  measured  outputs  y  and  the  regulated  outputs  z.  And 
K  is  the  controller  to  be  designed.  It  is  assumed  the  feedback  configuration  is  well-posed.  Both 
G  and  K  are  nonlinear  time-invariant  and  can  be  realized  as  control-affine  state-space  equations: 

{x  —  A(x)x  +  Bi(x)w  +  B2(x)u 

z  =  Ci(x)x  +  Dn(x)w  +  D12(x)u 

y  =  C2(x)x  +  D21(x)w  +  D22(x)u 

where  A,Bi,Ci,Dij  G  C°;  x ,  w,  u,  z,  and  y  are  assumed  to  have  dimensions  n,  pu  p2 ,  qu  and  q2, 
respectively. 

K  .  I  (  =  +  b(()v 

'  1  «  =  i'((K  + 

with  A,  B,C,i)e  C°.  It  is  assumed  that  the  feedback  system  evolves  in  (x,£)  E  X  x  X0,  where  X 
and  X0  are  open  convex  sets  and  contain  the  origins.  The  initial  states  for  both  plant  and  controller 
are  x(0)  =  0  and  £(0)  =  0. 

In  this  paper,  we  shall  consider  the  following  version  of  control  problem. 

(Strong)  Tfoo-Control  Problem:  Find  a  feedback  controller  K  (or  a  class  controllers)  if  any, 
such  that  the  closed-loop  system  has  strong  Tfoo-performance.  In  this  case,  the  feedback  system 
has  £2-gain  <  1>  i-e- 

/  (IHOII2  -  IKOII2)*  >  0; 

Jo 

for  all  T  G  K+. 

The  controllers  to  be  sought  in  solving  the  above  7fOT-Control  Problem  is  called  strong  Hoo- 
controllers.  Note  that  the  stability  issue  is  not  explicitly  touched  here,  as  it  is  guaranteed  by  the 
observability  assumption  (see  [14,  19]).  In  the  following,  we  will  mainly  consider  two  cases: 

•  The  state  x  is  directly  available  to  the  control  action  u,  so  the  problem  is  called  state  feedback 
co -control  problem.  We  will  examine  both  static  and  dynamic  state  feedback. 

•  Only  the  output  y  can  be  directly  measured,  so  in  this  case  the  problem  is  called  (output 
feedback)  7foo- control  problem.  We  will  mainly  consider  dynamic  feedback. 
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4  State  Feedback  TYoo-Control  Problem 

In  this  section,  we  consider  the  (strong)  7^^ -control  problem  that  the  state  x  is  directly  measured. 
We  will  first  consider  the  static  feedback  case  and  show  that  the  state  feedback  Woo -control  problem 
is  solvable  by  static  feedbacks  if  and  only  if  some  NLMI  has  required  solutions.  Next,  we  will 
consider  the  dynamic  state  feedback  77*, -control  problem,  and  show  that  the  dynamic  feedback  can 
not  do  better  than  static  feedback  can  when  the  strong  control  problem  is  considered. 

In  this  section,  we  consider  the  following  system, 

x  =  A(x)x  +  Bi(x)w  +  B2(x)u 

Gsf  :  l  z  =  Ci(x)x  +  Du(x)w  +  Di2(x)u  (15) 

y  =  x 

with  A,  Bi,  Ci,  D,j  G  C°.  The  state  x,  disturbance  w,  control  input  u,  and  regulated  out  put  2  have 
dimensions  of  n,pi,p2,  and  pi,  respectively;  and  n  +  qx  —  p2  >  0.  We  assume  that  system  evolves 

in  X,  rank  =  P2  and  D11(x)Dn(x)  <  I  for  x  E  X. 

Ul2{X) 

4.1  Static  State  Feedback 

Consider  the  system  Gsf •  Suppose  the  controller  u  —  F(x)x  is  such  that  the  closed  loop  system 

(  x  =  (A(x)  +  B2(x)F(x))x  +  Bi(x)w 

\  z  =  (Ci(x)  +  D12(x)F(x))x  +  Dn(x)w 

has  strong  Tioo -performance.  By  the  definition  2.3,  there  is  a  C°  positive  definite  matrix-valued 
function  X  =  XT  :  X^R"X'1  such  that  §7(2:)  =  2xTX(x)  for  some  C1  function  V  :  X-^E+  and 
the  following  NLMI  holds. 

(. AT(x )  +  FT{x)Bl{x))X(x)  +  X(x)(A(x)  +  B2{x)F(x))  X(x)B1(x)  Cf(x)  +  FT(x)D f2 

Bf(x)X(x)  -I  D^{x) 

Ci(x)  +  D12(x)F(x)  Dn(x)  -I 

We  use  the  notation  Msf(X,  F,  x)  to  represent  the  left  hand  side  of  the  above  inequality.  Define 

'  X-^x)  0  0 
r(x)=  0  7  0 

0  0  I 

which  is  well-defined  since  X(x)  >  0.  Note  that  Msf{X,  F,  x)  <  0  if  and  only  if 
Tt(x)Msf(X,F,x)T(x)<  0. 

Let  X(x)  =  P~1(x),  which  is  of  class  C°,  then 

Tt(x)Msf(P,  F,  x)T(x)  =  Msf(X,  x)  +  Xt(x)Ft(x)B(x)  +  BT(x)F(x)X(x)  <0  (16) 
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where 


'  XT(x)AT(x)  +  A(x)X(x)  Bx(x)  XT(x)Cf(x)  ' 

MSf(X,x):=  Bf(x)  -I  DT(x) 

Cx(x)X(x)  Dn(x)  -I 

X{x)  =  [  X(z)  0  0  ]  ,  B(x)  =  [  Bl(x)  0  Df2(x)  ' 

Now  by  lemma  8.6,  it  follows  that  there  is  a  solution  F(x )  for  (16)  if  and  only  if 

X[(x)MSf(X,  x)X±(x)  <  0  (17) 

B±(x)MSf(X,x)B±(x)  <  0  (18) 

for  some  X±(x)  such  that  span(Xx(x ))  =  M(X(x))  and  Bx(x)  with  span{Bx{x ))  =  A f(B(x)). 
Here  AT(B(x))  for  some  matrix-valued  function  B(x)  stands  for  the  distribution  which  annihilates 
all  of  the  row  vectors  of  B(x)  (see  (67)). 

Notice  that  (17)  is  guaranteed  by  the  assumption  I  —  Dl1(x)Du(x)  >  0;  (18)  is  actually  written 


'  XT(x)AT(x)  +  A(x)X(x)  B^x)  XT(x)Cf(x)' 

Bl(x )  Bf(x)  -I  D^(x)  Bx(x)  <  0  (19) 

Ci(x)X(x)  D11(x)  -I 

Whence,  using  Schur  complement  arguments,  we  can  conclude  the  following  theorem. 

Theorem  4.1  The  strong  static  state  feedback  'H^-control  problem  is  solvable  if  and  only  if  there 
is  a  C°  matrix-valued  function  X(x)  =  XT(x)  >  0  with  §7(2;)  =  2xT X~x(x)  for  some  C1  function 
V  :  X— >M+  such  that  for  all  x  £  X,  the  following  NLMI  holds: 

T  [  X(x)AT(x)  +  A(x)X(x)  +  B^Bfix)  X{x)Cf{x)  +  B1(x)D^(x)  „  (r\  <  n 

±[)  C1(x)X(x)  +  Dn(x)Bf(x)  Dxl{x)DTn{x)  - 1  xW  ~ 


with  Bx  :  X— pA  such  that  span(Bx(x ))  =  Af(B(x)),  where 
B(x)  :=  [  B?(x)  DUx)  ]  , 
for  all  i£X, 
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4.2  Dynamic  State-Feedback  vs.  Static  State-feedback 

Consider  system  Gsf •  Suppose  the  strong  TLoo -control  problem  is  solved  by  the  following  dynamic 
feedback 

K  .  /  i  =  MOZ  +  Bd(0 x 
d '  1 «  =  cd(oe  +  Dd(  ox 


with  Ad,Bd,Cd,Dd  £  C°.  Assume  £  G  X0.  The  closed  loop  system  with  state  xc 
follows 

{xc  =  Ac(xc)xc  +  Bc(xc)w 
z  =  Cc(xc)xc  +  Dc(xc)w 


x 

£ 


is  as 


where  Ac(xc )  =  Aa(x)  +  B%(x)Fc(£),  Bc(xc )  =  B?(x),  Cc(xc )  =  Cl (x)  +  D$2(x)Fc(£),  and  Dc(xc)  = 
Dlx(x)  with 


Aa(x )  := 


A(x)  0 
0  0  ’ 


Bt(x)  := 


B^x) 

0 


Ba2(x) 


B2(x )  0 
0  I  ’ 


Cl(x)  := 


Ci  (x)  0 


Du(x)  ■=  Dn(x), 


Dau(x) 


Du(x)  0 


and 


m) 


Dd(0  cd(0 

Bd(0  Ad{0 


So  the  original  problem  is  transformed  into  a  static  feedback  TLco -control  problem,  whence 
the  previous  results  apply.  It  follows  that  there  is  a  C°  positive  definite  matrix-valued  function 
Xc(xc )  =  Xf ( xc )  >  0  holds  for  all  xc  G  X  x  X  such  that  the  following  NLMI  holds  for  all  xc  G  X  x  X0 


Bl{x) 


Xc(xc)(Aa(x))T  +  Aa(x)Xc(xc)  Bl(x)  Xc{x){Cl1(x))T 
( Bl(x))T  -I  DTn(x) 

Cl(x)Xc(xc)  D11(x)  -I 


B±(x)  <  0 


(21) 


for  all  matrix- valued  function  B±(x)  such  that  span(Bx(x ))  G  J\f(B(x))  with 


B(x) 


B2(x)  0  D12(x) 
0/0 


Moreover,  there  is  a  positive  definite  function  Vc  :  X  x  X0— >R+  such  that  ^f(xc)  =  2xfXc  l(xc) 
for  all  (x,£)  G  X  X  X0.  Now  the  following  assumption  is  made. 


Assumption  4.2  There  is  a  C1  function  f>  :  x  »-»■  £  with  (f>(0)  =  0  such  that  ^(a;,£)|{=^(®)  =  0 
with  (i,£)gXxX,. 
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Note  that  the  above  assumption  is  not  very  restrictive  (see  remark  5.2). 

Now  the  NLMI  (21)  holds  for  all  (a:,£)  G  X  X  X„,  so  it  holds  for  ( x,fi(x ))  G  X  X  X„.  Define 
X  :  X-*RnXn  is  such  that 


Xc(x,<j>(x))  = 


X(z)  X?(x) 
Xi(z)  X0(z) 


Thus,  X(x)  is  also  positive  definite  and  of  class  C°.  In  this  case,  (21)  becomes 


Bl(x) 


X(x)AT(x)  +  A(x)X(x)  Bfix)  X(x)Cj(x) 
Bf(x)  -I  DUx) 

Ci(x)X(x)  Dn(x)  -I 


B±(x)  <  0 


(22) 


for  all  Bx(x )  with  span(Bj_(x ))  G  Af(B(x))  where  B(x)  := 


Bj(x)  0  DUx) 


Next,  let’s  further  consider  the  possibility  for  solving  the  Woo -control  by  static  state  feedback. 


Now  |^(®c)  =  2xfXc  1(xc)  implies  j^{xc)Xc(xc)  =  2xf ,  or 


dxc 


(x,0 


dVr. 

dt. 


(x,0 


Xc(x,0 


x 


(23) 


Now  take  £  =  <j>{x),  under  assumption  4.2,  (23)  implies  ^f(x,fi(x))X(x)  =  2xT .  Define  V(x)  := 
Vc(x ,  <j>(x)) ,  then  V(x)  is  positive  definite  such  that 


dV 

dx 


(x)  =  2xtX  1(x). 


(24) 


Combine  (22)  with  (24),  we  can  conclude  that  the  Woo -control  problem  is  indeed  solvable  in 
terms  of  static  feedback.  So  we  have  the  following  theorem. 


Theorem  4.3  Consider  the  state  feedback  Hoo-control  problem.  If  it  is  solvable  in  terms  of  the 
dynamic  feedback,  then  there  is  a  C°  positive  definite  matrix-valued  function  X  :  X— >Rnxn  such 
that  the  following  NLMI  holds 


B±(x) 


X{x)AT{x)  +  A(x)X(x)  +  B1(z)Bf(z)  X(x)Cf(x)  +  51(®)2?f1(* ) 


C1(x)X(x)  +  D11(x)Bf(x) 


DUx)Dn(x)-I 


B±(x)  <  0 


with  B±  :  X-^R^n+?1^x^n+?1  such  that  Af(B(x))  =  span(Bx(x)),  where 
B(x)  :=  [  B?(x)  DUx)  ]  , 

for  x  eX.  In  addition,  under  assumption  f.2,  the  Woo  control  problem  can  also  be  solved  in  terms 
of  static  state  feedback. 
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4.3  Output  Injection 

Analogically,  the  strong  Ttoo- control  problem  can  also  be  solved  in  terms  of  output  injections.  The 
output-injection  structure  is 


x 

z 


{  y 


A(x)x  +  Bi(x)w  +  u 
Ci(x)x  +  Dn{x)w 
C2(x)x  +  D21(x)w 


(25) 


with  A ,  Bi ,  Ci ,  Dij  6  C°.  Suppose  x,  w ,  u ,  2  and  y  have  dimensions  of  n,pi,n,  qi  and  q2 ,  respectively; 
and  n  pi  —  q2  >  0.  We  assume  that  system  evolves  in  X;  rank  C2(x)  D21(x)  —  q2  and 

Dii{x)Dn{x)  <  I  for  x  £  X.  The  solvability  condition  is  also  characterizes  in  terms  of  some 
NLMI;  and  the  strong  Tfoo-control  problem  is  solved  by  a  static  output  if  and  only  if  it  is  solved  by 
dynamic  output  injection.  This  fact  is  stated  in  the  following  theorem  without  proof. 


Theorem  4.4  The  strong  output  injection  TLoo-control  problem  is  solvable  if  and  only  if  there  is 
a  C°  matrix-valued  function  Y(x)  =  YT(x)  >  0  with  | j(x)  =  2 xTY(x)  for  some  C1  function 
U  :  X— >R+  such  that  for  all  i£X,  the  following  NLMI  holds: 


eft*) 


AT(x)Y(x)  +  Y{x)A(x)  +  Cf{x)Cx{x) 
Bj(x)Y(x)  +  Df^Cfix) 


Y(x)B1(x)  +  Cf(x)D11(x) 
Df^Dnix)  -  / 


C±.(x)  <  0 


(26) 


with  C±  :  X — *  R.(n+Pi)x(n+pi  qA  such  that  Af(C(x))  =  span(C±(x)),  where  C(x)  := 
for  all  x  £  X. 


C2(x)  D21(x) 


5  Output  Feedback  Tioo-Control  Problem 

In  this  section,  we  will  consider  the  general  strong  7fM-control  problem;  the  system  to  be  considered 
is 


X 

=  A{x)x 

+ 

Bi(x)w 

+ 

B2(x)u 

z 

=  Ci(x)x 

+ 

Dn(x)w 

+ 

D12(x)u 

(27) 

.  y 

=  C2(x)x 

+ 

Dn(x)w 

+ 

D22(x)u 

where  A,Bi,Ci,Dij  £  C°;  x,  w,  u,  z,  and  y  are  assumed  to  have  dimensions  n,  pi,  p2 ,  qi, 
and  q2,  respectively;  n  +  px  >  q2  and  n  +  qx  >  p2.  Suppose  the  system  (27)  evolves  in  X 

B2{x) 


which  is  a  convex  open  subset  of  Rn  and  contains  the  origin;  assume  rank 


Di  2(x) 


=  p2  and 


rank 


C\(x)  D21(x)  —  q2 ,  and  Du(x)Df1(x)  <  I  for  all  x  G  X. 
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5.1  Necessary  Conditions 

Suppose  the  strong  -controller  is  also  of  control-affine  form: 
K 


■{'. 


=  A(OZ  +  B(t)y 

u  =  c(  oe  +  £(0y 

with  A,B,C,B  G  C°.  Suppose  £  G  X0  C  Mn,i.  The  closed  loop  system  evolves  in  (a;,£)  G  X  x  X0. 
We  shall  also  assume  that  I  -  J}(£)D 22(2)  is  invertible  for  all  (a;,£)  G  X  x  X,  to  assure  the  well- 


posedness  of  the  feedback  structure.  Now  take  xc 


to  be  the  state  of  the  closed  loop  system; 


define  R(xc)  (I  -  B(£)B2 2(2))  1  for  (a:,£)  G  X  X  X0.  The  feedback  system  has  the  following 
description: 

{xc  =  Ae(xc)xe  +  Bc(xc)w 
Z  —  T  B  c{^x  f)w 

where 

A(x)  +  B2(x)R{xc)D(i)C2{x)  B2(x)R(xc)C(0 

Mm + B22(x)R(xc)£>(0)m)  Mo + Memmimio 


Ac(xA 


Bc(xc)  := 


Bi(x)  +  B2{x)R{xc)B(i)B21(x) 
B(0(B21(x)  +  B22(x)R(xc)B{0)B2i(x) 


Ce( xe)  :=  [  Ci(x)  +  B12(x)R(xc)B(Om)  B12(x)R(xc)C(0 

Bc(xc)  :=  Du(x)  +  D12(x)R(xc)B(OB21(x). 

The  main  theorem  of  this  section  is  stated  as  follows. 

Theorem  5.1  Suppose  there  is  a  solution  to  the  output  feedback  (strong)  7fTO  control  problem,  then 
there  are  two  C°  symmetrical  matrix-valued  functions  X,  Y  :  X— Mnxn,  which  are  positive  definite 
on  X,  such  that  for  all  x  G  X  C  Enxn: 

X(x)AT(x)  +  A(x)X  0)  +  B^mfix)  X(x)C((x)  +  B^Bf^) 

CAx)X{x)  +  B11(x)Bf( x)  B11(x)BU x)  -  I 


(i)  Bl{x) 


with  B±  :  X — 
(ii)  Cl(x) 


B±(x)  <  0 
(28) 

nJr<n)'*-{n+<n-Pi)  such  that  J\[(B(x))  =  span(B±(x))t  where  B(x)  :=  [  Bj(x)  Bf2(x) 


At(x)Y(x )  +  Y(x)A(x)  +  Cf  (x)Cx{x)  Y(x)B1(x)  +  Cf{x)B11(x) 
B?(x)Y(x)  +  Dlx(x)Cx(x)  BU*)Bn(x)  -  I 


C±(x)  <  0 
(29) 


with  C±  :  X— ►R(”+?’1)x(ra+Pl  qA  such  that M(C{x))  =  span(C±(x )),  where  C(x)  :=  C2(x)  B2i(x)  J, 


(Hi) 


X(x)  I 
I  Y(x ) 


>  0. 


Remark  5.1  It  is  noted  that  all  couples  (X{x),  Y(x))  satisfying  the  inequalities  (i),  (ii)  and  (in) 
form  a  convex  set.  Therefore,  theorem  5.1  provides  a  convex  characterization  to  the  necessary 
conditions  for  the  strong  output  feedback  ’HCM -control  problem  to  be  solvable. 
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Proof  Define 


Aa{x) 


A(x )  0 
0  0  ’ 


Bt(x) 


B1(x) 

0 


B“(xc) 


B2(x)  0 

B{£)Dn(x)  I  ’ 


Cl{x) 


Ci(x)  0 


D n(a; )  Dn(x),  D12(x) 


Du(x)  0 


Ca2(x) 


C2(x)  0 
0  /  ’ 


D\ i(*) 


D2i(x) 

0 


Da22{x) 


0  0 
0  0  ’ 


and 


Fc(xc) 


Thus 


R(*c)D(Q  R(Xe)C(  0 

m  Mo 


Ac  =  Aa(x)  +  Ba2(xc)Fc(xc)Ca2{x),  Bc(xc)  =  B^x)  +  Ba2(xc)Fc(xc)Da21(x), 

Cc(xc)  =  C\  +  Da12Fc(xc)CZ(x),  Dc(xc )  =  Dan(x)  +  D“2(x)Fc(xc)Da21(x). 

Since  the  feedback  system  has  strong  Tf^-performance,  by  definition  2.3,  there  is  a  C°  positive 
definite  matrix-valued  function  Pc(xc )  on  X  X  X„  such  that 


AA c ( Pc ;  Xc)  .- 


ATc(xc)Pc(xc)  +  Pc(xc)Ac(xc)  Pc(xc)Bc(xc )  Cj(xc) 
Bj(xc)Pc(xc )  -I  DTc{xc) 

Cc(xc )  Dc(xc )  -/ 


<  0. 


(30) 


Re-organizing  the  left  hand  side  of  the  above  NLMI  yields 
MC(XC,  xc)  =  Ma(Pc,  xc)  +  CT(x)Fj (xc)B(xc)Tc(xc)  +  Tj (xc)BT(xe)Fc(xc)C(x)  <  0  (31) 

where 


(. Aa(x))TPc(xc)  +  Pc(xc)Aa(x )  Pc(*c)Bl(x)  (Q(x)f 
(Bl(x)fPe(xc)  -I  {D°u{x))T 

Ci(x)  Dan(x)  -I 


AAa(PCJXe^ 

B(x.)  :=  [  (Bf(*«))T  o  (Bf2(x))r  I  .  <?(*)  :=  I  CJ(*)  D°n(x)  0 


<  0. 


and 


Tc(xe) 


Pc(xc)  0  0 

0  10 
0  0  / 


So  it  follows  from  lemma  8.6  that  (31)  holds  if  and  only  if  the  following  two  inequalities  hold 
(see  lemma  8.6): 

Bl (xc)Te~T(xc)Ma(Pc,  xc)Tc-\xc)B±(x e)  <  0,  (32) 
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(33) 


Cl{x)Ma{Pc,xc)C±{x)  <  0 


for  all  B±(xc )  with  span(B±(xc))  £  J\f(B(xc))  and  C±{x)  with  span(C±(x ))  6  Af(C(x)). 
Now  we  consider  (32),  notice  that  N(B(xc))  =  Af(B(x))  for 


B{x)  := 


B%(x)  0  0  Dj2(x) 
0/0  0 


(34) 


Thence,  (32)  holds  if  and  only  if 

Bl(x)T-T(xc)Ma(Pc,xc)Tc-\xc)B±(x)  <  0, 
for  all  B±(x)  with  span(B±(x))  £  Af(B(x)).  On  the  other  hand,  notice  that 

P~\xc)(Aa(x))T +  Aa(x)P~\xc)  Bf  (*)  P;\x)(Can(x))T 


T~T(xc)Ma(PciXc)T~1(xc) 


DTn(x) 
-I 


( Bl{x))T  -I 

C?(x)Pc-\xc)  Dn(x) 

Since  Pc(xc )  =  Pc(x ,  £)  is  invertible  on  X  x  X„,  assume  X(x)  —  XT(x)  £  Rnxn,  which  is  positive 
definite  and  of  class  C°  on  X,  is  such  that 


Pc  \x,<t>{x))  = 


X(x)  Xf(x) 
Xl(x)  X0(x) 


(35) 


for  some  continuously  differentiable  function  <f>  :  x  h->  £  in  X  such  that  <jf>(X)  C  X0  (for  example 
4>  can  be  chosen  as  <f>(x)  =  0).  Therefore,  by  the  arguments  of  Schur  complements,  (34),  i.e.  (32) 
implies 


Bl(x) 


X{x)At{x)  +  A(x)X(x)  +  B^Bjix)  X(x)C({x)  +  B^D^x) 
C1(x)X(x)  +  Dn(x)Bf (x)  D11(x)Dj1(x)  -  I 


Bj_(x)  <  0 


with  B±  :  X— »R(n+«0x(n+?i  pA  such  that  Af(B(x))  =  span(B±  (a;)),  where  B(x)  :=  B2(x)  Dj2(x) 

Thus,  the  first  part  is  proved.  Now  if  we  take  Y(x)  £  R"xn,  which  is  of  class  C°,  such  that 


Pc(x,  4>(x)) 
then  (33)  implies 

CT±(x) 


Y{x )  Yf(x) 
Yi(x)  Y0(x) 


(36) 


AT(x)Y(x)  +  Y(x)A(x)  +  C[(x)C!(x)  Y(x)B1(x)  +  C1(x)D11(x) 
B[(x)Y(x)  +  Bf^C^x)  DUx)Dn(x)  -  / 


C±(x)  <  0 


withCx  :  X^-R(”+pdx(n+Pi -t»)  such  that  M{C(x))  =  span(C_i (*)),  where  C(x)  :=  C2(x)  D21(x) 

Now  what  is  left  un-proved  is  the  last  part.  But  by  lemma  8.5,  (35)  and  (36)  hold  if  and  only  if 


X(x)  I 
I  Y{x) 


>  0. 

This  concludes  the  proof. 


□ 
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5.2  Output  Feedback  and  State  Feedback 

In  this  section,  we  further  show  that  if  the  Woo-control  problem  is  solvable  by  output  feedback, 
then  it  is  also  solvable  by  static  state  feedback  and  static  output  injection.  This  statement  is  not 
trivial,  and  is  not  the  conclusion  of  the  above  theorem.  This  point  will  be  clear  from  the  following 
discussion. 

Suppose  the  output  feedback  strong  ^.-control  problem  for  the  given  system  (27)  is  solvable, 
then  there  is  a  C°  positive  definite  matrix-valued  function  Pc(xc)  such  that  (30)  holds.  Moreover, 
there  is  a  positive  definite  function  Vc(xc)  such  that 

|^(®«)  =  2  xTcPc(xc) 

We  make  the  following  assumption. 

Assumption  5.2  There  is  a  C1  function  <j>  :  x  i— >■  £  with  (f>( 0)  =  0  such  that  ^-(x,  £)|f-^(*)  =  0 
with  (x,£)  6  X  X  X„. 


Remark  5.2  This  assumption  as  well  as  assumption  f.2  is  not  surprising.  In  fact,  many  dynamical 
controllers  are  observer-like-based  [2,  If,  19,  16].  So  the  states  x,£  of  a  plant  and  its  controller 
have  a  relation  £  =  for  some  C1  function  :  x  >->■  £  with  <f>( 0)  —  0  if  the  initial  states  satisfy 
£(0)  =  <f>(x( 0))  and  the  disturbance  is  not  imposed.  The  Lyapunov  function  for  the  closed  loop 
system  can  be  taken  as  Vc(x,Q  =  V(x)  +  U(£  -  4>{x))  where  V  and  U  are  Lyapunov  functions  of 
the  state-feedback  system  and  the  observer.  Thence,  ^(x,f)  =  ^-(e)|e=f-^(i)-  Now  if  e  =  0,  i.e. 
£  =  4>(x),  then  ^(®,f)lc=*(*)  =  §7(e)|e=o  =  0.  Therefore,  Vc  satisfies  the  assumption. 


Now  from  the  proof  of  the  last  theorem,  it  follows  that  (30)  implies  that  there  is  X(x )  = 
XT(x )  £  Knxn,  which  is  positive  definite  and  of  class  C°  on  X,  such  that 


Pc  (*))  = 


X{x)  Xf(x) 
Xi{x)  X0{x)  ’ 


for  some  continuously  differentiable  function  <f> :  x  £  on  X,  and  the  following  NLMI  holds, 


Bl(x) 


X(x)AT(x)  +  A{x)X(x)  +  B1(x)Bf(x)  X(x)C?(x)  +  B^Dffix) 
Ci(x)X(x)  +  Dn{x)Bf  (x)  Dn(x)Djfix)  -  I 


B±(x)  <  0 


with  Bx  '■  X— >R(n+?1lx(n+?1-P2)  such  that  Af(B(x))  =  span(B±(x)),  where  B(x)  J  Bf  (x)  Df2(x)  j. 

Now  we  take  the  function  <f>  as  in  assumption  5.2,  define  V(x)  :=  Vc(x,  (j>{x)).  By  the  similar 
argument  in  subsection  4.2,  it  follows  that  V(x)  is  positive  definite  and 


OV 

dx 


( x )  =  2xt X  ^a;). 


(37) 


So  it  can  be  concluded  that  the  Woo -control  problem  is  indeed  solvable  in  terms  of  static  feedback. 
Thence,  we  have  the  following  proposition. 


Proposition  5.3  If  the  strong  Hoo-control  problem  is  solvable  in  terms  of  the  output  feedback,  then 
under  assumption  5.2,  it  can  also  be  solved  in  terms  of  static  state  feedback. 
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Similar  argument  applies  to  output  injection  problem.  Taking  (f> :  x  i-+  £  as  <j)(x)  =  0.  Define  a 
positive  definite  matrix- valued  function  Y (x)  =  YT(x)  G  such  that 


Pe(M) 


Y(x)  lf(i) 

UM  r0(*) 


Define  f7(;r)  =  Fc(a:,0),  which  is  positive  definite,  then  j~-(xc)  =  2a;f  Pc{xc)  implies 

^(x)  =  2zTr(z). 

Thus,  by  combining  (29)  and  (38),  we  also  have  the  following  result. 


(38) 


Proposition  5.4  If  the  strong  Hoo -control  problem  is  solvable  in  terms  of  the  output  feedback,  then 
it  can  also  be  solved  in  terms  of  static  output  injection. 


5.3  An  Example 

In  this  subsection,  we  will  examine  an  example  which  is  from  [6,  19].  The  basic  diagram  is  as 
follows. 


w  l 


w  2 


u 


Where  P  is  the  nonlinear  plant;  K  is  the  controller  to  be  designed  such  that  the  output  z1  is 
regulated;  y  is  the  measured  output,  based  on  which  the  control  action  u  is  produced;  w2  is  the 
disturbance  from  the  actuator;  and  w1  is  the  noise  from  the  sensor.  The  control  problem  is  to 
design  the  controller  K  such  that  the  influence  of  the  noises  and  w2  on  the  regulated  output  zx 
can  be  reduced  to  the  minimal  with  the  reasonable  effort  (control  action  should  not  be  too  large). 

To  formulate  this  problem,  all  the  signals  are  considered  in  space  jC2[0,  oo);  define  the  optimal 
achievable  £2-gain  for  this  feedback  system  to  be 

7*:=inf{7:  f  (|N|2  +  |M|2)d*  <  72  /  (||wi||2  +  \\w2\\2)dt,  VT  G  R+;  wu  w2  £  £2[0,  oo)}(39) 
K  Jo  Jo 

The  Woo-control  problem  in  this  setting  is  formulated  as:  Give  7  >  7*,  find  K  such  that 

/  (INI2  +  IMI2)^<72  f  (IK||2  +  IKII2)<ff,vr  g  e+ 

Jo  Jo 

In  this  example  ,  the  plant  has  the  following  realization: 

x  =  ex(w2  +  u ) 

<  Z\  =  x  +  wx 
y  =  x  +  wx 
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It  is  known  from  [6]  that  the  optimal  achievable  C2- gain  for  this  feedback  system  is  7*  =  \/2. 
Take 

... .  ui  . .  1  r  2i  1 


•"  [  ^2  J  ~  y/2[u  \ 

as  input  and  output  vectors,  then  the  state-space  realization  is 
x  =  0  ex  w  +  exu 

<  2  =  ^  x  +  ^  w  +  1  u 

L  U  J  [  u  u  L  75 

y  —  x  -fi  [  1  0  w 


Therefore,  there  should  be  a  controller  K  such  that  the  closed  loop  system  satisfies 


fT  rT 

/  \\zfdt<  /  ||u;||2dt,VT  €  E+ 
Jo  Jo 


Whence,  the  three  conditions  (i),  (ii)  and  (iii)  in  theorem  5.1  should  be  satisfied.  We  now  verify 
this. 

We  first  consider  NLMI  in  condition  (i),  which  is  as  follows 

r  0  1  0  1  [  e!'  *x(l)  0  If 0  -1 

,  ;  JL  ±,x<z)  -1/2  0  1  0  <  0, 


0  1  0  1  r  e“  *x(i)  0 1  f 0 

[-*•  r  -JU 

it  is  equivalent  to 

f  -1/2  -**(*)  1<0 
~e2x  ~ 

Thus,  all  positive  definite  solutions  satisfy 
X(x)  <  ex. 

The  NLMI  in  condition  (ii)  is  as  follows 


0  0  1 

1  -1  0 


1/2  1/2  exY(x)  I  f  0  1 


1/2  -1/2  0 

exY{x)  0  -1 


0-1  <0, 
1  0 


which  is  equivalent  to 

-1  exY(x)  1 
exY(x)  -1  J  “ 

Therefore,  all  positive  definite  solutions  satisfy 


Y(x)  <  e~x 
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We  then  take  two  special  solutions  in  (40)  and  (41)  as 
X(x)  =  ex,  Y{x)  =  e~x. 

Then  X(x)Y{x )  =  1,  which  implies  condition  (iii),  i.e., 


Actually,  the  optimal  £2-gain  -\/2  is  achieved  by  constant  feedback  K  =  —1.  This  can  be  checked 
using  theorem  2.5. 

6  Solutions  to  Nonlinear  Matrix  Inequalities 

In  this  section,  we’d  like  to  consider  the  computational  issue  in  solving  the  NLMIs  that  appear  in 
this  paper,  i.e.,  (8),  (9),  (19),  (20),  (28),  and  (29).  Technically,  the  material  in  this  section  is  also 
of  independent  interest. 

6.1  Existence  of  Continuous  Solutions 

In  section  2.2,  we  justified  the  existence  of  positive  definite  solutions  to  NLMIs.  Since  the  solvability 
for  each  strong  "Hoo -control  problem  requires  that  the  positive  definite  solutions  to  the  corresponding 
NLMIs  be  continuous,  a  natural  question  is  that,  is  there  such  a  solution  to  a  NLMI  if  it  has 
positive  definite  solutions?  In  this  section,  we  will  justify  this,  i.e.,  we  will  consider  the  existence 
of  continuous  solutions  to  the  given  NLMIs  provided  that  there  are  some  solutions  but  we  don’t 
know  if  they  are  continuous.  We  tackle  this  problem  using  the  set-valued  map  machinery  [1].  For 
a  brief  review  about  set-valued  maps,  consult  Appendix  8.3. 

Let  S(Rnxn)  be  the  set  of  all  (n  x  n)-dimensional  symmetric  matrices,  and  P(R"xn)  be  its  subset 
of  semi-positive  definite  matrices.  Both  are  Banach  spaces  with  the  Euclidean  norm.  Let  X  be  an 
open  subset  R"  with  0  6  X,  consider  a  general  matrix-valued  map  M  :  P(Rnxn)  x  X— >S(Rmxm), 


which  is  continuous  and  satisfies 

M{aP1  +  (1  -  a)P2,x)  =  aM(P\,x)  +  (1  -  a)M(P2,  x).  (42) 

for  some  a  €  R.  Consider  the  following  matrix  inequality. 

M(P,x)<  0.  (43) 

Note  that  all  of  the  NLMIs  discussed  in  this  paper  are  in  this  matrix  inequality  class. 
Next,  define  two  set-valued  functions  .F,  .F:  X  P(Rnx")  as 
P(x)  :=  { P  :  M(P,  x)  <  0}  (44) 

F(x)  :=  {P  :  M(P,x)  <  0}  (45) 


It  is  assumed  that  both  set-valued  functions  T  and  f  are  strict,  i.e.,  Dom(T)  =  X  and  Dom(j)  = 
X. 

It  is  observed  that  the  set- valued  maps  T  and  t  have  following  properties. 

Lemma  6.1  (i)  The  set-valued  function  T  :  X  P(R"X")  takes  values  as  closed  convex  subset  of 
P(Rnxn). 

(ii)  JF  :  X  ~->  P(Rnxra)  takes  values  as  convex  subset  of  P(R”X"). 
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Proof  We  only  prove  part  (i),  since  (ii)  can  be  proved  similarly. 

Take  x  G  X,  consider  the  value  P(x).  We  first  examine  the  convexity  of  T(x).  Let  PX,P2  € 
P(x),  then  by  (44), 

M(Pux)<  0,  M(P2,x)<  0. 

For  any  a  G  [0, 1],  by  (42) 

M(aPi  +  (1  -  a)P2,x)  =  aM(Pi,x)  +  (1  -  a)M(P2,x)  <  0. 
so  aPi  +  (1  —  a)P2  G  T{x). 

Next,  consider  the  closedness  of  T(x).  Let  {P„}  C  P(x)  be  a  sequence  which  converges  to 
P0  G  P(Rnxn).  We  need  to  prove  P0  G  P(x).  In  fact,  P„  G  P(x)  implies 

0>M(P„,x),V»G  {1,2,3, •••} 

Since  M.  is  continuous,  it  follows  by  taking  limits  on  both  sides  that 
0>  lim  M(Pn,x)  =  M(  lim  P„,x)  =  M(Pq,x) 

n—+OQ  n — >-oo 

which  implies  P0  G  P(x).  □ 

Lemma  6.2  (%)  The  set-valued  function  T  :  X  P(R"Xn)  is  lower  semi-continuous. 

(ii)  T  :  X  P(R”xn)  is  lower  semi-continuous. 

Proof  The  part  (i)  is  proved  here,  part  (ii)  follows  similarly. 

Take  x0  G  X,  let  P0  G  P(x0),  and  e  >  0.  Now  it  is  sufficient  to  show  that  there  is  a  neighborhood 
N(a;0)  of  x0  G  X  such  that  for  all  x  G  N(a;0)>  there  exists  a  Px  G  P{x)  fl  {P  :  ||P  —  P0||  <  e}. 

By  the  choices  of  x0  and  P0,  it  follows  that 

M(Po,xo)<0. 

Now  we  claim  that  there  is  a  Px  G  P(Rnxn)  which  satisfies  \\PX  —  P0||  <  e  such  that 
M(Px,x  0)<0.  (46) 

In  fact,  since  T  is  strict,  there  is  Pi  G  F(x0)  such  that 
M(Pi,x0)  <  0, 

moreover,  Pi  G  P(x0);  on  the  other  hand,  the  convexity  of  T(x0)  implies  that  there  exists  Px  = 
oP0  +  (1  —  a)Pi  satisfying  \\PX  —  P0||  <  c  with  some  a  G  [0, 1)  such  that  Px  G  iF(x0).  Moreover, 

M(Px,x 0)  =  M(aP0  +  (1  -  a)Pi,x0)  =  aM(P0,x0 )  +  (1  -  a)M(Pi,x0)  <  0, 

which  confirms  the  claim.  On  the  other  hand,  since  M(P,x)  is  continuous,  for  fixed  Px  which 
satisfies  (46),  there  is  some  S  >  0,  such  that  if  x  G  N(a;0)  :=  {a:  :  ||a;  —  a:0||  <  <5}  C  X,  then 

M(Px,x)  <  0. 

so  Px  G  T(x).  So  there  indeed  exists  a  Px  G  P(x)  fl  {P  :  ||P  —  Po||  <  e}.  □ 

Now  the  main  result  of  this  section  is  stated  as  follows: 
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Theorem  6.3  Suppose  the  matrix  inequality  M(P,x )  <  0  has  a  positive  semi-definite  solution 
P  =  PT  >  0  for  each  a:  £  X,  then  there  exists  a  C°  matrix-valued  function  P  :  X— >EnXn  with 
P(x)  —  PT(x)  >  0,  such  that  M(P(x),x )  <  0  for  all  a:  6  X. 

Proof  Since  the  set-valued  function  T  :  X  P(Mrix")  is  defined  as 
F(x)  =  {P  :M(P,x)  <0}, 

by  lemmas  6.1  and  6.2,  T  takes  closed,  convex  sets  as  its  values  and  is  lower  semi-continuous. 
Therefore,  Michael’s  selection  theorem  (see  lemma  8.7)  applies,  and  there  is  a  continuous  selection 
P  :  X— *-P(EnXn)  from  F,  i.e.  M(P(x),x)  <  0  for  all  a:  £  X.  □ 


6.2  Construction  of  Continuous  Solutions  to  NLMIs 

The  computational  issue  of  NLMIs  can  be  pursued  in  terms  of  the  techniques  for  solving  LMIs, 
which  can  be  solved  in  terms  of  convex  optimization  methods  [3].  In  this  section,  we  demonstrate 
how  this  works.  Let  X  be  an  open  subset  En  with  0  £  X.  In  this  subsection,  we  consider  the 
NLMIs  discussed  in  the  preceding  subsection  (43): 

M(P,x )  <  0. 

with  a:  £  X,  where  M  :  P(EnXn)  X  X-+S(Emxm)  is  continuous  and  satisfies  (42),  i.e.: 

N  N 

M(J2<XkPk,x)  = 

k= 1  fc=l 

for  all  ak  >  0  with  Ylk=i  ak  =  1- 


6.2.1  Existence  of  Local  Constant  Solutions  to  NLMIs 


In  this  subsection,  we  are  considering  the  existence  of  local  constant  solutions  to  NLMIs.  To  be 
more  concrete,  we  take  the  NLMI  (9)  as  an  example. 


AT(x)P(x)  +  P{x)A(x)  P(x)B(x)  CT(x) 
Bt  (x)P(x)  —I  DT(x ) 

C(x)  D(x)  ~I 


<  (<)0. 


where  the  coefficient  matrix- valued  functions  A(x),  B(x),  C(x),  D{x)  are  assumed  to  be  continuous 
on  bounded  open  subset  N  C  E".  Denote  the  left  hand  side  of  the  above  NLMI  as  M(P7C(x)), 
where  C  is  the  coefficient  function  C  :  x  [A(x),B(x),C(x),D(x)]  which  is  continuous  on  N,  so 
there  are  some  constant  matrices  A,,5j,Cj,A  with  I  —  Df  Dj  <  0  for  i  £  {1,2, •  •  •, L}  for  some 
positive  integer  L,  such  that 


C(x)  £  Co{[Aj,  Bi,  Ci,  14,]|,g{ii2, - } r  Vx  6  N, 

where  Co  stands  for  the  convex  hull.  If  there  is  a  constant  (semi-)positive  definite  matrix  P  £  Enx 
such  that 


MiPMuBuCuDi})  <  (<)0,V*£  {l,2,-.-,L}, 


(47) 
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i.e., 

'AjP  +  PAi  PBi  CJ  ' 

BJP  -I  DJ  <(<)0,ViG  {1,2, 

C{  A  -I  _ 

which  are  a  set  of  linear  matrix  inequalities  (LMIs)  and  can  be  solved  in  terms  of  convex  optimization 
methods  [3],  then  P  also  satisfies 

M(P,C(x))  <  (<)0. 

for  all  x  E  N;  i.e., 

'  AT{x)P  +  PA(x)  PB(x )  CT(x)  " 

BT{x)P  -I  DT{x )  <  (<)0. 

C(x)  D(x)  -I 

for  all  x  £  N.  For  detailed  discussion  about  the  solutions  of  LMIs,  consult  [3]. 

6.2.2  Construction  of  Continuous  Solutions  of  NLMIs 

Here,  we  again  are  not  going  to  specify  the  forms  of  NLMIs.  Let  X  be  an  open  subset  R”  with 
0  €  X.  Consider  the  NLMI  (43): 

M (P,  x)  <  0. 

with  i£X,  where  M  :  P(Rnxn)  X  X— >S(RmXm)  is  continuous  and  satisfies  (42),  i.e.: 

N  N 

M(£akPk,x)  =  YlakM(Pk>x)  (48) 

k= 1  *=1 

for  all  ak  >  0  with  otk  =  1. 

The  set  valued  functions  T :  X— >P(Rnxn)  are  defined  as  in  (44)  and  (45).  It  is  assumed  that 

both  T  and  T  are  strict,  i.e.,  Dom(^r)  =  X  and  Dom(^)  =  X. 

Since  Dom(j)  =  M,  for  each  x  £  X,  there  is  a  semi-positive  definite  Px  6  R"x"  such  that 
M(Px,x)  <  0. 

(Note  that  the  continuity  of  M  with  respect  to  the  first  argument  enables  us  to  choose  Px  to 
be  positive  definite).  By  continuity  of  M  with  respect  to  x,  there  is  a  rx  >  0  such  that  for  all 
xQ  G  N(z)  :=  {#0  :  IN  -  «||  <  rx), 

M(Px,x  o)<0.  (49) 

(For  practical  computation,  we  can  use  the  process  introduced  in  section  6.2.1  to  get  the  local 
solution  for  a  given  neighborhood  N(x).) 

On  the  other  hand,  {N(a:)}|a;6x  is  an  open  covering  of  X ,  i.e., 

X  C  |J  N(*)  (50) 

*ex 
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Since  the  space  Rn  is  paracompact,  there  is  a  locally  finite  open  subcovering  {N,}|<6i  for  some  index 
set  I  which  refines  {N(x)}|;c6x  [1,  p.10].  By  (49),  Pi  G  R”xn  is  taken  to  be  (semi-)positive  definite 
for  each  *  €  I  such  that 

M{Pi,x)<  0.  (51) 

for  all  x  G  N,-. 

It  is  known  by  the  standard  results  of  continuous  partitions  of  unity  (see,  for  instance,  [1, 
pp.9-11])  that  there  is  a  locally  Lipschitzean  partition  of  unity  {V’ijliei  to  X  subordinated  to  the 
covering  {N;}|,-6i;  i.e.,  rj) ,•  is  locally  Lipschitzean  and  non-negative  with  support  Supp(ipi)  c  N,  for 
each  i  G  I,  and 

£>.•(*)  =  1,V*GX.  (52) 

*ei 

Define  a  matrix-valued  function  P  :  X— »P(Rnxn)  as 

PW^^Pi.VxeX,  (53) 

iei 

which  is  (semi-)positive  definite  and  continuous  since  it  is  locally  a  finite  sum  of  continuous  (semi- 
positive  definite  matrix-valued  functions. 

So  it  follows  from  (52),  (53)  and  (48)  that 

M(P(x),x)  =  M(]£fa(x)Pi,x)  =  ^2 il>i(x)M(Pi,x)  <  0 
«e  i  «'€  i 

The  last  equality  holds  since  the  sum  is  finite  for  each  iEX. 

Thence,  the  constructed  C°  matrix-valued  function  P  :  X-»P(Rnxn)  in  (53)  is  (semi-)positive 
definite  and  is  a  solution  to  M(P(x),x)  <  0. 

6.3  Remarks  on  Solvability  of  Tfoo-Control  Problems 

As  mentioned  earlier,  the  existence  of  semi-positive  definite  matrix- valued  function  P  :  X— P(R’,xn) 
to  NLMIs  is  not  enough  to  gaurantee  the  strong  'H00 -control  problem  to  have  solution;  some  ad¬ 
ditional  requirement  is  imposed  in  this  paper,  i.e.  there  is  a  C1  function,  which  is  called  storage 
function,  V  :  X^R+,  such  that 

J^-(x)  =  2xTP(x) 

for  all  x  G  X.  In  this  subsection,  we  will  examine  explicitly  when  it  is  the  case  for  the  solution 
constructed  in  the  preceding  subsection. 

Consider  the  NLMI  (43): 

M(P,x )  <  0 

with  x  G  X,  where  M  :  P(Rnxn)  x  X— »-S(Rmxm)  is  continuous  and  satisfies  (42),  i.e.: 

N  N 

M(^akPk,x)  =  Y2akM{Pk,x) 

k=l  k= 1 
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for  all  ak  >  0  with  J2k=i  ak  —  !• 

From  the  preceding  subsection,  a  matrix-valued  function  P  :  X— »-P(R"xn),  which  satisfies 
M(P,x)  <  0,  is  constructed  as  (53) 

P(x)  =  ^A(x)Pi,Vx£X, 
i€  I 

for  some  index  set  I,  where  {V’tjliei  is  a  partition  of  unity  of  X  and  P,  =  Pj  >  0.  We  further 
assume  X  C  Rn  is  bounded,  then  I  can  be  chosen  to  be  finite,  i.e.  I  =  {1,2,  •  •  • K }.  As  for  each 
i  £  I,  A  '•  X— >-R+  is  locally  Lipschitzean,  A  is  absolutely  continuous  on  X;  x )  exists  almost 
everywhere  on  X.  For  clarity,  we  assume  A  £  C1.  Now  let  dA  be  the  differential  of  Ai  it  is  a 
1-form  on  X,  so 

dA  =  itj^-dxj^i  £  1  =  {1,2,..., K}.  (54) 

j= i  oxi 

On  the  other  hand,  for  each  i  £  I,  define  a  function  Vi  :  X— >R+  as 
Vi(x)  =  xT  PiX.  (55) 

The  differential  dVi  of  Vz  also  defines  a  1-form  on  X,  and 


dxi 


where  dx  := 


L  dxn  J 

With  the  above  preparation,  we  state  the  main  result  of  this  subsection  as  follows. 


Theorem  6.4  Suppose  the  matrix  valued  function  P  :  X— *-P(Rnx”)  defined  by 


K 

P(x)  =  J2Mx)pi  (57) 

i=l 

with  ipi  :  X— >R+  being  of  class  C1  and  Pi  £  P(R"xn)  for  i  £  {1,2,*--,  PT }  satisfies  (43):  M(P ,  x)  < 
0  for  all  x  £  X;  let  Vfix)  —  xT P{X  for  all  i  £  {1,2,  •  •  • ,  K}.  There  exists  a  C2  function  V  :  X-+R 
such  that  =  2 xTP(x)  if  and  only  if 


(58) 


for  all  x  £  X  and  j,  l  £  {1, 2,  •  •  • ,  n}  with  j  ^  1. 
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Proof  Define  a  1-form  w  on  X  as  follows 

K 

u> —  ^T^idVi  (59) 

«  =  1 

So  by  (56),  it  follows  that 

K 

u(x)  =  ^2  ifri(x)xT  Pidx  =  2  xT  P(x)dx 
*=1 

Thus,  there  is  a  C2  function  V  :  X— »R  such  that  |^(x)  =  2 xTP(x)  if  and  only  if  u  =  dU,  i.e.  the 
1-form  defined  by  (59)  is  exact.  Since  the  space  Rn  is  contractible,  by  Poincare  lemma  (lemma  8.1), 
the  later  statement  is  equivalent  to  that  the  1-form  u  is  closed,  i.e.  the  2-form  du  on  X,  which  is 
the  differential  of  u,  is  0. 

On  the  other  hand, 

K  K 

du  =  d(%2  i’idVi)  =  ^2  d'lpi  A  dV{ 

i  =  1  i  =  1 


^  ^  fj'T'  .  r)T) 
i= 1  j  <1  ux 1  0X1 


(Hh 

dxi 


-~-)dxj  A  dxt 

(jXj 


(60) 


y-y 

j<i  i= i  axi  0X1 


djh 

dxi 


^2^-)dxj  A  dxi. 
dxj 


(61) 


Where  (60)  is  derived  by  substituting  dip,  and  dV)  from  (54)  and  (56)  and  then  re-organizing  it  by 
using  that  dxi  A  dxj  =  —dxj  A  dxi  (so  dxj  A  dxj  =  0)  for  j,l  6  {1, 2,  •  •  • ,  n). 

From  (61)  and  the  linear  independence  of  2-forms  {dxj  A  dir/}|;</,  it  follows  that  du  =  0  if  and 
only  if 


yy  dipj  dVj 

—  Ox,  dx i 

2  =  1  J  ' 


dj>i 

dxi 


dVi, 

dx; 


)  =  0, Vj, l  G  {1,2 ,•••,»},;  <  /, 


which  is  equivalent  to  (58). 


□ 


7  Concluding  Remarks 

In  this  paper,  we  have  characterized  the  Ttoo-control  problem  for  a  class  of  nonlinear  systems  in 
terms  of  nonlinear  matrix  inequalities  which  result  in  the  convex  problems.  Unfortunately,  unlike 
the  linear  case,  the  solution  of  the  NLMIs  by  themselves  are  not  sufficient  to  guarantee  the  existence 
of  the  required  controller.  However,  the  proposed  approach  indeed  points  out  a  new  direction  to 
make  the  nonlinear  Hoc -control  theory  to  be  applicable. 
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8  Appendix:  Some  Technical  Results 


8.1  Equation  |^(x)  =  2 xTP(x) 

In  this  subsection,  we  shall  strictly  treat  and  clarify  some  issue  related  the  equation: 


—0)  =  2xT  P(x)  (62) 

where  P  =  PT  :  X— >RnXn  and  V  :  X— >R.  X  is  an  open  convex  subset  in  R”  containing  the  origin. 
Unless  otherwise  stated,  it  is  assumed  that  P  6  C°  and  V  EC1.  In  addition,  V  £  C1  satisfies  (62) 
if  and  only  if  F(a;)  =  xTQx  +  r(x)  with  some  Q  =  QT  E  Rnxn  and  C1  function  r  :  X— >R  satisfying 


lim 

x--+0 


=  o. 


We  first  characterize  a  class  of  matrix- valued  function  which  satisfies  (62)  with  some  function 
V  :  X-*R.  The  derivation  depends  on  the  following  lemma  which  is  known  as  Poincare  lemma  (see 
[25,  p.306]). 


Lemma  8.1  If  M  is  a  smoothly  contractible  manifold,  then  every  closed  form  on  M  is  exact. 
Lemma  8.2  Suppose  a  matrix-valued  function  P  :  X— >Rnxn  is  of  class  C  ,  let 


P(x)  =  [Pi(*)  Pa(x)  •••  Pn(*)], 

define  v{(x)  =  xTpi(x )  for  i  =  1, 2,  •  •  •,  n  and  a:  €  X.  Then  there  exists  V  :  X- 

&V. 

dx 

if  and  only  if 


such  that 


-(x)  =  2  xT  P(x) 


“  £(I)- 


(63) 


for  all  i,j  =  1,2, 


,  n. 


Proof  Since  v{  :  x  i-»  xTpi(x )  defines  a  differentiable  function  on  X,  so  its  differential,  dv{,  defines 
a  1-form  on  X,  and 
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On  the  other  hand,  define  a  1-form  as 

n 

u>  =  ^  Vidxi  =  2  xTp(x)dx 

i  =  1 


dx  i 


where  da:  := 


L  J 

Thence,  there  exists  V  :  X— >-R  such  that  |j(a;)  =  2 xrP(x)  if  and  only  if  oj  =  dF,  i.e.  the 
1-form  defined  above  is  exact.  Since  the  space  Rn  is  contractible,  by  Poincare  Lemma,  the 
later  statement  is  equivalent  to  that  the  1-form  u  is  closed,  i.e.  the  2-form  du>  on  X,  which  is  the 
differential  of  ui,  is  0. 

On  the  other  hand, 


n  n 

du)  =  d(^2  Vidxi)  =  ^  dxi  A  dx ,■ 
2=1  * = 1 


Where  the  last  equality  is  derived  by  using  that  dxt  A  dxj 
i,  j  (E  { 1 , 2 ,  •  •  • ,  n} . 

From  the  linear  independence  of  2-forms  {dxj  A  daq}|J<;, 


dvi  dv; 


dx. 


=  0 ,Vi,i  €  {1, 2,  j  <  i, 


=  —dxj  A  dxi  (so 
it  follows  that  duj 


dxj  A  dxj  =  0)  for 
=  0  if  and  only  if 


which  is  equivalent  to  (63). 


□ 


Lemma  8.3  Let  V  :  X— >R  with  F(0)  =  0  be  such  that 
J~(x)  =  2xTP(x) 

for  some  P  =  PT  :  X— >R”xn.  If  P(x)  >  0  for  all  x  G  X,  then  V(x)  >  0  for  all  x  G  X  \  0;  if 
P(x )  >  0  for  all  x  £  X,  then  V(x )  >  0  for  all  x  E  X. 

Proof  We  prove  the  former  statement  here,  the  latter  statement  is  proved  similarly.  Suppose 
V(x0)  <  0  for  some  i0£X  and  x0  /  0. 

Since  V  G  C1,  by  the  mean- value  theory,  there  exists  k  G  (0, 1)  such  that 

fiV 

V(x0)  -  F(0)  =  —  (kx0)(x0  -  0)  =  2 kxg  P(kx0)x0, 
ox 
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as  V(x0 )  —  V^(O)  <  0,  the  above  equality  implies 

xlP(kx0)x0  <  0.  (64) 

Oil  the  other  hand,  since  P(kx 0)  >  0  by  assumption,  a;0  7^  0,  so 

x'lP{kx0)xa  >  0.  (65) 

Note  that  (64)  and  (65)  lead  to  a  contradiction.  This  completes  the  proof.  □ 


8.2  Schur  Complements 

A  reference  for  the  material  here  is  [11]. 

Lemma  8.4  Suppose  M  -  MT  G  ]RO+m)xO+m)  is  portioned  as 


M  = 


A  B  ‘ 
BT  C 


with  C  G  Rm+m  is  non-singular,  then  P  >  0  if  and  only  if  C  >  0  and  A  —  BC  1 BT  >  0. 

Lemma  8.5  Let  X  =  XT ,Y  =  YT  G  Rnxn  be  two  positive  definite  matrices.  Then  there  is  a 
positive  definite  matrix  P  =  PT  G  ]R(n+m)x(n+m)  such  that 


XX f 

A'i  X0 


P-1  = 


if  and  only  if 


X  I 
I  Y 


>  0. 


8.3  Characterization  of  a  State-Dependent  LMI 

Consider  a  matrix-valued  function  B  :  M-^Rmxn,  with  m  <  n. 
bfix) 

B(x)  =  j 

.  bm(x) 

with  b1(x),b2(x),  •  •  • ,bm(x )  are  (smooth)  co-vector  fields.  They  span  a  (smooth)  co-distribution: 

0(J3(x))  :=  $pan{b1(x),b2(x),  ■  ■  •  ,bm(x)}  (66) 

It  is  assumed  that  each  x  G  M  is  a  regular  point  of  Q,(B(x)),  and  the  dimension  of  the  co-distribution 
dim(0(i?(a:)))  =  m;  thus,  there  is  an  (n  —  m)-dimensional  (smooth)  distribution  fif(B(x))  which 
is  the  annihilator  of  f l(B(x)),  i.e. 

M{B{x))  :=  {n  G  R"  :<  w*,v  >=  O,Vi0*  G  fi(5(a;))}  (67) 

Moreover,  there  is  a  (smooth)  matrix-valued  function  B±  :  M^R"x(^n_m\  such  that  its  columns, 
which  are  (smooth)  vector  fields  on  M,  span  the  distribution  Af(B(x)),  i.e.  Af(B(x))  =  span(B±(x )) 
for  x  G  M.  The  reader  is  referred  to  [12]  for  more  detailed  introduction  about  distributions  and 
co- distributions. 

The  following  lemma  follows  from  [4]  (see  for  example,  [24,  9,  15]). 
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Lemma  8.6  Consider  the  following  matrix  inequality 

Q(x)  +  Ut(x)Ft(x)V(x)  +  Vt(x)F(x)U(x)  <  0  (68) 

with  Q  =  QT  :  U  :  M^Rrxm  with  dim(il(U(x))  =  r  <  m,  and  V  :  M-dRsxm  with 

dim(fl(V(x ))  —  s  <  m,  then  (68)  has  a  solution  F  :  M— ►R5Xr  if  and  only  if 

Ul(x)Q{x)U±{x)  <  0,  Vl (x)Q(x)V±(x)  <  0 

for  some  Uj_  :  M-^MmX^m_r^  such  that  span(Ux(x )  =  J\f(U(x))  and  V±  :  such  that 

span(V±(x)  —  N(V(x)). 

8.4  Set- Valued  Maps  and  Their  Selections 

A  reference  for  the  material  here  is  [1]. 

Let  X  and  y  be  two  sets.  A  set  valued  map  F  from  X  to  y  is  a  map  that  associates  with 
any  x  £  X  a  subsect  F(x)  of  y.  We  denote  it  as 

F  :X  ^  y. 

The  subsets  F(x)  are  called  the  values  of  F.  The  domain  of  F  is  defined  as 
Dom(F)  :=  {x  £  A  :  F(x)  ±  0}. 

The  map  is  said  to  be  strict  if  Dom(F')  =  X. 

Definition  8.1  The  set-valued  map  F  :  X  y  is  said  to  be  lower  semi-continuous  at  x0  £  X 
if  for  any  y  G  F(x  0)  and  any  neighborhood  N  (y)  of  y,  there  exists  a  neighborhood  N(*0)  of  x  0  such 
that  for  all  x  £  N(x0),  F(x )  fl  N (y)  ^  0.  F  is  said  to  be  lower  semi-continuous  if  it  is  lower 
semi-continuous  at  every  x0  G  X . 

When  X  and  y  are  metric  spaces,  the  above  definition  can  be  phrased  as  follows:  Given  any 
sequence  {xn}  C  X  converging  to  x0  EX  and  any  y0  G  F(x  0),  there  exists  a  sequence  {yn} 
with  yn  G  F(xn)  that  converges  to  y0.  Unlike  the  single-valued  maps,  the  above  definition  is  not 
equivalent  to  the  following  statement:  For  any  open  subset  N  of  y  containing  F(x0),  there  exists 
a  neighborhood  N(a:0)  of  x 0  such  that  F(N(x0))  C  N.  Actually  the  latter  statement  defines  upper 
semi-continuity  of  set-valued  maps. 

Given  a  set-valued  map  F  :  X  y,  it  is  known  from  the  Axiom  of  Choice  that,  there  is  map 
/  :  X— >y  which  is  a  selection  of  F,  i.e.  f(x)  £  F(x)  for  each  x  £  X .  For  a  class  of  set-valued 
maps,  we  have  the  following  lemma  which  is  known  as  Michael’s  selection  theorem  (cf  [1]). 

Lemma  8.7  Let  X  be  a  metric  space,  y  a  Banach  space,  F  :  X  y  which  has  the  closed  convex 
subsets  as  its  values  be  lower  semi-continuous.  Then  there  exists  a  continuous  selection  f  :  X— 
from  F. 
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